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Summary 

This  is  a  talk  delivered  at  the  National  Convention  of 
the  American  Institute  of  Industrial  Engineers,  June  12,  1958, 
in  Los  Angeles,  California. 

It  Is  an  exposition  of  some  of  the  general  problems 
facing  one  in  the  construction  of  a  simulation  process,  and 
of  some  of  the  Ideas  that  can  be  used  to  treat  these  problems. 
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TOP  MANAGEMENT  DECISION  AND  SIMULATION  PROCESSES 

Richard  Bellman 

The  RAND  Corporation 
Santa  Monica,  California 

I  would  like  to  talk  today  about  circulation  processes  In 
general  and  a  Top  Management  Decision  Game  In  particular. 

This  Top  Management  Decision  Game  Is  a  kind  of  ”do— It— yourself '* 
kit  for  producing  executives.  It  Is  hoped  that  this  game  will 
produce  executives  who  are  trustworthy,  loyal,  helpful, 
friendly,  courteous,  kind,  obedient,  cheerful,  thrifty,  brave, 
clean,  and  reverent.  Furthermore,  I  am  told  that  wlille  playing 
the  game,  the  players  receive  beneficial  radiation,  and  that 
the  very  pencils  they  chew  are  Impregnated  with  vitamins. 

The  first  question  that  should  be  asked  Is:  Why  are 
people  Interested  these  days  In  m.anagement  training  programs, 
and  why  do  we  have  simulation  processes? 

Probably  the  principal  reason  vje  do  have  simulation  pro¬ 
cesses  Is  that  various  organizations  aio  willing  to  pay  for 
them — and  pay  fairly  good  prices.  After  all,  there  Is  a  law 
of  supply  and  demand  In  the  scientific  world  as  well  as  else¬ 
where.  Naturally,  the  next  question  Is:  Why  are  people 
willing  to  pay  fancy  prices  for  the  construction  of  these 
games  and  for  the  privilege  of  participating  in  them? 

The  answer  Is  obvious — there  must  be  problems  around  of 
some  Import  that  cannot  be  solved  readily  and  quickly.  The 
majority  of  people  in  responsible  positions,  company  presidents. 
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generals  and  admirals  in  high  military  positions,  are  convinced 
that  the  problems  that  face  us  in  economic  and  military  life 
are  that  level  of  complexity  and  significance  that  they  warrant 
sustained  research.  They  require  a  great  deal  of  thought  and 
a  great  deal  of  effort  by  individuals  of  high  Intellectual 
level.  Since  these  problems  are  so  difficult,  it  is  recognized 
that  we  must  start  nov;  if  we  wish  to  obtain  results  five  and 
even  ten  years  from  now. 

In  view  of  the  foregoing  remarks,  it  is  natural  to  ask  why 
these  problems  are  so  difficult.  An  easy  answer  is  that  they 
are  complicated.  We  face  processes  involving  a  large  number  of 
interactions,  an  enormous  nxamber  of  factors,  and  a  bewildering 
variety  of  decisions. 

The  enterprising  company  president  facing  this  situation 
decides  to  buy  a  giant  computer.  Ke  has  read  of  what  these 
electronic  brains  can  do,  how  they  are  able  to  perform  fantastic 
calculations  calling  upon  storage  facilities  for  hundreds  and 
thousands  of  bits  of  information.  What  can  be  simpler  and  more 
progressive  than  to  purchase  this  tame  monster  and  solve 
problems  in  this  fashion'’ 
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The  company  president  buys  one  of  the  biggest  and  fastest 
machines,  turns  to  his  planners  and  programmers,  presents  them 
with  charts  crammed  full  with  data,  and  says:  "Solve  the 
following  problems  foi-  me;  put  *em  on  the  machine!" 

At  this,  the  programmer  and  the  planner  are  apt  to  become 
a  bit  Indignant.  "After  all,"  they  say,  "we  know  that  these 
machines  are  fantastic  devices.  But  they  are  not  thinking 
machines — someone  has  to  tell  them  what  to  do." 

Now,  of  course,  this  may  not  Jibe  with  what  you  may  have 
read  In  the  Svinday  supplements  and  In  some  of  the  over— enthusi¬ 
astic  publicity  that  occasionally  appears.  One  somehow  gets 
the  impression  from  these  sources  that  computing  machines  solve 
their  ovm  problems. 

The  general  impression  that  one  gets  Is  that  of  a  room, 
tastefully  decorated,  with  a  big  machine  at  one  end  flashing 
lights  and  a  little  table  at  the  other  end.  One  enters,  places 
a  problem  on  the  table  and  tiptoes  out.  TlTe  next  morning  one 
finds,  In  the  very  same  place,  the  solution,  typed  out  and 
bound  In  quiet  Morocco. 

Fortunately  for  mathematicians,  bxit  unfortunately  for 
executives,  things  don't  vfork  that  way. 

After  all  this  has  been  explained,  the  company  president 
generally  says,  perhaps  reluctantly,  "OK,  let's  hire  some 
mathematicians.  If  we  caji't  solve  the  problems  by  ourselves, 
let  the  miathema  tic  Ians  solve  It." 

The  mathematician  gravely  surveys  the  problem  and  he  says. 
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"This  Is  a  very  \insatlsfactory  type  of  problem  as  far  as  the 
mathematician  is  concerned,  for  the  following  reasons.  In  the 
engineering  world,  we  face  precise  problems.  We  may  vrish  to 
construct  a  space-ship  to  go  to  Mars  or  Venus;  v;e  may  wish  to 
construct  a  multi-stage  missile.  The  question  is  that  of  con¬ 
structing  a  device  that  will  attain  a  given  velocity,  carry 
an  assigned  payload,  and  be  able  to  penetrate  hundreds  of 
thousands  or  hundreds  of  millions  of  miles  into  space — a  clear- 
cut  problem." 

V/hatever  the  engineering,  physical  or  mathematical 
obstacles,  we  can  clearly  state  our  objective. 

When  we  turn  to  the  military  and  business  end  of  the  world, 
we  find  to  our  great  surprise  that  we  frequently  cannot  say 
exactly  what  we  want  to  do.  Since  this  is  a  rather  startling 
statement,  let  us  examine  it  a  bit  in  order  to  help  you  believe 
it.  Consider  the  following  sample  example.  We  approach  a 
business  man  and  we  ask:  "What  are  you  trying  to  do?  What  is 
your  objective  in  running  your  firm?"  Generally,  he  will 
answer,  "I  am  trying  to  make  money."  At  which  point  we  reply, 
"Are  you  interested  in  maxlirizlng  the  amount  of  money  that  you 
villl  make  this  year'."  And  he  will  answer:  "Well,  certainly, 

I  want  to  maximize  the  profit  over  the  coming  year." 

At  this,  we  point  out  that  this  isn't  all  he  wants  to  do. 
Otherwise,  he  would  sell  the  business,  lock,  stock  and  barrel, 
and  over  a  period  of  one  year  show  an  enormous  profit. 

Naturally,  this  idea  is  rejected — he  does  want  to  stay  in 
business.  In  other  words,  not  only  must  he  worry  about  the 
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Immediate  revenue  over  the  coming  year,  but  he  must  take  Into 
account  the  continuation. 

If  we  press  further  and  ask  how  he  knows  whether  or  not  he 
is  in  a  favorable  position,  and  hov/  he  evaluates  his  business, 
he  will  talk  about  share  of  the  market,  new  products, 
efficiency,  unit  cost,  and  easily  a  half-dozen  other  factors. 

After  listening  patiently,  we  may  say:  ’’Here  are  the  six 
or  a  dozen  factors  that  you  mentioned.  Please  write  down  a 
precise  formula  which  tells  me  how  you  evaluate  these  factors. 
Which  are  most  Important,  and  how  do  you  weigh  one  against  the 
other?" 

As  soon  as  we  ask  a  specific  question  of  this  type.,  there 
is  silence.  Since  we  have  great  faith  in  experts,  the  temp¬ 
tation  is  to  turn  to  an  expert  and  ask  him  for  the  answer  to 
these  questions.  We  find  to  our  dismay  that  there  are  no 
precise  answers. 

Consequently,  the  very  first  difficulty  that  we  encounter 
in  trying  to  tackle  some  of  the  formidable  problems  of  the 
economic  and  military  world,  and  in  trying  to  tackle  them  by 
means  of  scientific  techniques,  is  that  we  cannot  even  state 
the  problems  clearly. 

After  a  certain  amount  of  sadness,  and  self-pity,  we  decide 
to  Introduce  artificial  but  reasonable  criteria.  Suppose  for 
the  moment  that  we  measure  success  in  terms  of  the  amount  of 
money  made  over  ten  years,  suitably  discounted. 

Having  successfully  dodged  the  difficulty  of  evaluation, 
the  next  type  of  question  that  arises  in  our  attempt  to  apply 
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mathematical  methods  is:  "What  happens  when  a  decision  is 
made?" 

Suppose,  for  example,  that  we  decide  that  a  conservative, 
old-line  firm  needs  some  pepping— up  in  the  form  of  an  adverti¬ 
sing  campaign.  Should  one  spend  a  qtiarter  of  a  million  dollars, 
half  a  million  dollars  or  a  million  dollars,  and  hov/  do  these 
expenditures  on  TV,  Radio  or  Magazine  advertising  affect  sales? 

Once  again  we  think  of  turning  to  experts,  advertising 
experts  in  this  case.  V^e  know,  of  course,  that  actually  there 
isn't  anyone  who  can  furnish  this  information. 

Consequently,  at  this  point  the  mathematician  again  com¬ 
plains.  Kow  can  one  use  mathematical  techniques  if  there  are 
no  formulas?  'fhe  temptation  is  to  classify  these  problems  as 
impossible.  We  don't  lonow  the  precise  result  of  a  decision, 
and  we  don't  even  lonow  precisely  why  v;e  want  to  make  these 
decisions . 

For  some  mathematicians  there  is  a  very  easy  way  out  of 
this  irritating  situation.  They  turn  to  other  fields. 

Unfortunately,  the  Intelligent  person  who  is  concerned  with 
these  matters  cannot  avail  himself  of  this  simple  refuge.  He 
knows  from  past  experience  that  if  the  person  of  ability  side¬ 
steps  his  responsibilities,  if  he  retreats  from  these  problems  as 
too  difficult,  there  is  always  someone  else  around  with  complete 
faith  in  his  own  ability  to  resolve  these  questions. 

The  problem  the  mathematician  must  face  is  the  follov/ing: 
Using  all  his  mathematical  ability,  using  all  the  techniques  of 
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modem  computers,  can  he  do  something  in  this  field  which  is 
better  than  what  can  be  done  by  an  executive  with  only  business 
experience  to  guide  him?  In  general,  the  answer  would  be — no  I 
If  we  have  a  choice  of  two  experts,  one  a  mathematician  with 
digital , computers ,  the  other  an  executive  with  thirty  years  of 
experience,  we  would  certainly  rely  upon  the  business  man  to 
make  an  Important  decision. 

In  view  of  the  fact  that  we  cannot  hope  for  an  analytic 
solution,  is  there  some  way  we  can  bypass  the  cost  in  time 
required  for  experience?  Is  there  some  method  for  speeding  up 
the  process  of  acquiring  experience?  With  this  thought  in  mind, 
let  us  turn  to  the  idea  of  a  simulation  process. 

A  simulation  process  is  a  quite  obvious  engineering  idea. 

It  is  the  concept  of  the  pilot  plant,  the  towing  tank  and  the 
wind  tunnel — a  simple  and  yet  fundamental  idea. 

V/e  say:  If  we  cannot  analyze  a  process  in  purely  mathe¬ 
matical  fashion,  scientifically  according  to  simple  principles 
and  formulas  thereby  deduced,  at  very  least  what  we  can  do  is 
watch  it.  We  will  watch  the  process,  observe  what  happens,  and 
in  that  way  learn  what  to  do . 

However,  as  I  have  Just  pointed  out,  in  the  business  world 
it  appears  that  one  has  to  watch  for  quite  a  long  while — ten 
years,  twenty  years,  thirty  years.  In  other  words,  in  treating 
really  Important  processes  we  must  realize  that  the  only 
totally  realistic  model  of  the  process  is  the  process  Itself. 

It  follows  that  in  studying  many  of  the  significant  problems 
of  the  business  and  military  world  we  cannot  use  this  simple 
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engineering  technique  in  any  naive  fashion.  It  is  not  suffi¬ 
cient  to  say  that  we  shall  merely  watch  and  wait. 

We  are  forced  back  to  use  of  mathematical  and  scientific 
techniques — lanconventional ,  and  perhaps  more  sophisticated  in 
some  ways,  but  still  scientific  .techniques.  The  use  of  simu¬ 
lation  techniques  represents  the  application  of  standard  sci¬ 
entific  methods  to  areas  which  have  not  previously  been  treated 
to  any  extent  by  scientific  techniques.  These  areas  are 
particularly  those  in  the  economic  and  military  spheres. 

To  take  a  particular  example,  consider  the  problem  of 
running  a  multi— million  dollar  organization.  We  attempt  to 
abstract  certain  basic  features  and  use  these  to  construct  a 
small-scale  model.  It  is  hoped  then  that  something  can  be 
learnt  from  these  models. 

Now  model— making  is  an  art,  and  quite  a  complicated  one. 

It  is  complicated  even  in  the  physical  world  where  we  have  had 
several  hundred  years  of  experience.  Hence,  it  is  even  more 
complicated  in  fields  in  which  only  recently  have  scientific 
techniques  been  Introduced.  Our  aim  is  to  study  at  any  parti¬ 
cular  time  a  small  number  of  the  factors  that  influence 
decision-making  and  to  try  and  determine  the  effects  of  vari¬ 
ous  types  of  policies. 

Running  these  processes,  which  we  call  simulation  processes, 
over  and  over  under  varying  conditions,  we  hope  to  build  up 
synthetic  experience. 

All  of  this  is  quite  vague,  and  quite  difficult.  In 
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attempting  to  construct  a  simulation  process,  we  are  faced  by 
the  question  of  pinpointing  factors  of  Importance.  Also  we 
must  describe  the  effects  of  the  various  possible  decisions. 

We  thus  seem  to  be  right  back  facing  the  problems  that 
discouraged  us  initially.  How  do  we  single  out  Important 
factors  and  how  do  we  evaluate  policies. 

What  saves  us  from  despair  Is  the  knowledge  that  there  do 
exist  people  who  perform  these  complicated  decision— making  roles 
In  outstanding  fashion.  Tlriere  are  successful  executives  and 
there  are  successful  generals.  Consequently,  there  must  be 
ways  of  overcoming  these  difficulties  to  some  extent. 

In  order  to  see  how  this  may  be  done,  let  us  examine  the 
Idea  of  the  scientific  method.  One  method  that  has  been 
enormously  successful  is  what  we  may  call  the  syllogistic 
approach,  the  usual  logical  algorithm. 

Starting  with  a  fact  "A,"  we  observe  that  ’’A"  Implies  "B," 
"B”  Implies  "C,"  and  "C"  implies  "D."  Consequently,  when  "A" 
occurs,  we  make  a  decision  based  upon  "D.”  This  has  been  such  a 
successful  method  In  many  fields,  that  we  tend  to  think  that  It 
Is  the  only  method  that  can  be  used. 

Actually,  It  Is  not  the  way  that  most  of  us  come  to  con¬ 
clusions.  If  you  consider  any  of  the  significant  processes  of 
life,  you  soon  realize  that  there  Is  never  enough  known  to  make 
successful  deductions  of  the  type  described  above. 
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'what  we  do  when  foi'ced  to  make  a  decision  is  to  search  our 
memories  and  try  to  recall  a  similar  situation.  If  we  can  do 
this  and  rem.ember  certain  decisions  which  were  successful,  and 
others  which  were  unsuccessful,  we  possess  valuable  clues  as  to 
further  successful  behavior.  What  we  are  calling  upon  Is  exper¬ 
ience,  memory  of  past  similar  situations. 

The  idea  we  wish  to  stress  Is  that  In  most  situations  we 
perceive  more  by  analogy  than  by  deduction. 

Processes  that  seem  to  reveal  this  quite  well  are  those  of 
chess  and  poker.  We  all  know  that  there  are  good  chess  players 
and  good  poker  players.  To  hear  some,  however.  It  would 
appear  that  there  are  merely  lucky  and  unlucky  players.  It  Is 
next  to  Impossible  to  get  a  consistent  loser  to  admit  that  his 
play  is  defective.  On  the  otFer  hand,  these  players  are  beloved 
by  their  friends  and  there  is  always  room  for  them  around  the 
table . 

Let  us  turn  to  the  game  of  chess.  Attempting  to  analyze 
chess  scientifically,  we  see  that  we  require  a  means  of 
evaluating  a  given  position.  We  need  an  expert  who  can  look  at 
a  particular  position  and  evaluate  It  as  a  winning  or  losing 
position.  What  is  desired  Is  a  formula  which  will  take  account 
of  the  positions  of  all  the  pieces  and  come  out  with  a  yes  or 
no  answer — a  win  or  a  loss. 

Fortunately  for  the  game  of  chess,  nobody  has  yet  been  able 
to  do  this.  Examine  the  most  profound  studies  of  the  greatest 
chess  players  and  you  find  that  they  cannot  tell  why  it  Is  that 
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they  play  excellent  chess.  They  can  i'^urnish  all  kinds  of  sound 
strategic  principles,  and  these  are  of  great  help.  Put  they 
have  no  means  of  formalizing  exactly  v^hat  they  do. 

Nonetheless,  people  do  learn  how  to  play  chess,  some 
better,  some  worse.  What  I  wish  to  emphasize  Is  that  our  in¬ 
ability  to  describe  a  process  in  precise  mathematical  terms 
does  not  at  all  mean  that  people  cannot  operate  efficiently  In 
a  situation  of  this  type.  In  other  words,  we  must  not  be 
spoiled  by  the  standard  approach  of  engineering,  physics  and 
applied  mathematics  in  general,  which  demands  a  completely 
formulated  problem  and  a  clear  cut  solution.  These  are 
luxuries,  but  not  necessities. 

If  we  Insist  upon  asking  for  the  best  way  to  proceed,  we 
may  get  into  difficulties.  This  is  mainly  due  to  the  fact  that 
we  don’t  know  what  we  mean  by  "best.”  If,  however,  we  agree  to 
try  to  construct  various  training  processes  V'/hlch  will  teach 
people  how  to  proceed  in  reasonably  good  fashion  in  situations 
of  the  type  described  above,  then  it  is  quite  plausible  that 
something  can  be  done. 

The  game  of  poker  Is  an  excellent  example  of  this  general 
premise.  Here  Is  a  game  which  lends  itself  to  mathematical 
analysis  to  a  slightly  better  degree  than  the  highly  complex 
decision  processes  we  have  been  discussing.  Nonetheless,  there 
Is  no  theory  which  predicts  exactly  how  to  play  optimally  In  a 
five  or  seven— handed  game.  However,  using  native  Intelligence 
and  experience,  one  can  become  a  competent,  if  not  gifted, 
player. 
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Aware  of  the  difficulties  that  I  mentioned  above,  and  aware 
also  of  some  of  the  compensating  factors,  about  tv/o  years  ago 
five  hardy  souls  got  together  to  consider  the  problem  of  con¬ 
structing  a  simulation  process-  that  might  be  useful  in  training 
executives.  The  purpose  of  this  simulation  would  be  to  furnish 
the  synthetic  experience  that  would  cut  down  on. the  usual  time 
required  for  training. 

These  five  were  Don  Malcolm  and  an  assistant,  Charles 
Clark,  from  Poos— Allen  and  Hamilton,  Franc  Rlcciardl  and  an 
assistant.  Cliff  Craft,  from  the  American  Management  Association, 
and  myself,  from  the  RAND  Corpoi’atlon . 

V/e  v;ere  ratlier  an  ideal  group  in  that  we  had  few  overlap¬ 
ping  abilities;  v;hat  one  of  us  knew,  the  others  did  not.  Conse¬ 
quently,  it  was  seldom  necessary  to  take  a  vote,  or  to  discuss 
matters  at  too  great  length.  As  is  well  known,  the  ideal  size 
of  a  comrrdttee  is  1.2,  and  we  v;ere  violating  this  to  some 
extent.  Hovrever,  \-ie  compensated  for  this  by  our  Ignorance  in  so 
many  areas.  As  many  have  pointed  out,  it  is  veyrj  Important  not 
to  let  an  over— accumulation  of  knowledge  impede  progress. 

Since  construction  of  games  of  this  general  nature  had  been 
tried  before,  we  did  have  the  benefit  of  the  mistakes  of  others. 
Taking  advajctage  of  this  experience,  we  felt  that  we  could  con¬ 
struct  a  v;orkable  game  if  we  kept  everything  fairly  simple.  We 
didn't  have  to  be  very  bright;  all  vfe  had  to  do  vias  to  avoid 
the  mistakes  of  predecessors.  This  was  part  of  it;  it  turned 
out  that  the  problem  w^as  more  complex  than  imagined.  In  order 
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to  conquer  all  the  difficulties,  to  some  extent,  we  also  had  to 
be  lucky.  I  will  explain  in  a  moment  why  it  was  that  we  needed 
luck. 

I  would  like  to  emphasize  that  in  complex  research  pro¬ 
grams  of  this  type,  mistakes  cannot  be  avoided.  Upon  first 
traveling  down  a  road,  all  bypaths  look  equally  inviting.  Only 
upon  having  traversed  it  a  few  times  do  we  begin  to  recognize 
certain  of  these  as  dead-ends  and  others  as  through— ways . 

At  the  very  beginning,  we  thought  that  it  might  be  feas¬ 
ible  to  copy  the  type  of  war  game  that  the  military  forces  have 
utilized  for  some  time.  These  Involve  vast  quantities  of  men 
and  equipment.  A  little  thought  showed  that  this  was  certainly 
unworkable  in  a  business  game. 

One  of  the  reasons  that  the  armed  forces  can  engage  in 
vast  scale  maneuvers  is  because  to  a  great  extent,  each  of  the 
participant  groups  follows  preassigned  patterns. 

In  the  construction  of  our  game,  we  had  to  take  into 
accovint  a  number  of  serious  constraints  on  time,  expense  and 
complication.  Since  we  were  thinking  of  processes  of  some 
degree  of  realism  and  magnitude,  it  was  clear  from  the  begin¬ 
ning  that  we  would  have  to  think  in  terms  of  digital  computers. 
It  is  rather  surprising  that  the  capacity  of  a  computer  is  one 
of  the  limiting  factors  in  the  construction  of  a  simulation 
process . 

There  is  no  question  about  the  fact  that  computers  are 
really  magic  devices.  In  the  space  of  a  few  hours,  with  their 
aid  we  can  solve  problems  that  would  have  required  months  even 
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ten  years  ago.  Nonetheless,  their  capacity  is  not  as  great  as 
might  be  imagined  from  a  quick  reading  of  their  publicity  hand¬ 
outs.  It  is  fairly  easy  in  Just  a  few  minutes  of  enthusiasm, 
thinking  of  all  the  factors  that  one  would  like  to  Include  in  a 
model  of  a  business  enterprise,  to  overwhelm  completely  any 
modern  computer. 

In  view  of  this,  and  in  view  of  the  fact  that  processes 
that  overv^fhelmed  a  computer  milght  very  well  do  likewise  to  the 
players,  we  decided  to  construct  a  fairly  simple-minded  game. 

Only  one  product  would  be  manufactured  and  sold,  to  the  t\ine  of 
a  fevi  simple  decisions,  namely:  How  much  should  we  produce? 
Should  we  build  more  plant  capacity  to  increase  production? 

Should  we  spend  money  on  research  and  development,  and  on  adver¬ 
tising?  What  price  should  we  charge?  These  were  the  basic 
questions . 

The  first  problem  that  faced  us  was:  If  this  was  to  be  a 
game,  how  could  we  tell  the  players  whether  they  were  winning 
or  losing?  In  bridge,  football,  chess,  or  tiddlywinks,  we  have 
simple  criteria  for  winning  or  losing.  But  in  the  economic  and 
military  spheres,  no  such  simple  criteria  exist,  except  perhaps 
at  the  very  end  of  the  process. 

After  the  equivalent  of  five  or  seven  years  of  play,  there 
will  be  some  indication  of  a  trend.  It  would,  hov/ever,  be  nice 
to  know  before  that  time.  As  I  pointed  out  before,  this  is  a 
fundamental  problem  and  there  is  no  simple  way  around  it. 

Fortunately,  we  can  sidestep  it  in  a  very  simple  fashion — 
we  refuse  to  tell  the  players  whether  they  are  winning  or  losing. 
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Instead,  we  say:  "You're  a  business  man,  you  evaluate  the 
situation.  Use  the  experience  you  have  had  In  the  business 
world,  and  act  exactly  as  you  would  in  a  realistic  situation." 

This,  of  course,  puts  the  burden  of  the  problem  upon  the 
players  and  upon  the  construction  of  the  game.  The  simulation 
has  to  be  accurate  enough  so  that  people  will  take  It  seriously, 
and  the  players  must  be  mature  enough  so  that  they  will  not 
try  outlandish  strategies.  They  must  be  people  who  are 
interested  In  testing  serious  policies. 

We  have  had  considerable  success  In  both  respects.  We 
have  found  that  the  game  has  been  realistic  enough  to  attract 
attention  and  Interest,  and  we  have  been  fortunate  In  obtaining 
a  considerable  number  of  serious  players. 

One  of  the  most  gratifying  features,  from  the  professional 
point  of  view,  has  been  that  the  business  men  consistently  beat 
the  mathematicians.  This  is,  of  course,  the  way  it  should  be. 

If  the  game  is  to  pretend  to  realism,  it  must  be  true  that  the 
person  who  has  had  experience  in  the  business  world  should  be 
able  to  use  this  experience  to  do  far  better  than  someone  like 
myself  who  is  merely  familiar  with  all  the  formulas  that  go 
into  the  game. 

I  say  this  with  a  certain  amount  of  bitterness,  because  I 
would  have  liked  to  have  won.  Although  I  have  always  had 
excellent  theories,  somehow  the  other  players  have  never  been 
as  cooperative  as  they  could  be.  The  result  has  been  that  I 
have  never  done  well,  and  thus  have  been  forced  to  console  my¬ 
self  with  the  thovight  that  this  Is  an  excellent  Indication  of 
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the  realism  of  the  process . 

Having  passed  the  criterion  hurdle,  with  a  certain  amount 
of  s.gonizlng  soul-searching,  we  came  to  the  problem  of  deter¬ 
mining  cause  and  effect.  As  I  have  remarked  above,  vie  don't 
know  v/hat  happens  v/hen  advertising  is  increased,  or  prices  are 
lowered.  On  the  other  hand,  we  must  give  a  digital  computer 
specific  instructions.  We  cannot  ask  it  to  use  Its  discretion. 

It  is  necessary  to  have  specific  forrculas  which  tell  how 
our  share  of  the  market  has  changed  as  a  consequence  of  our 
decisions,  and  the  decisions  of  our  competitors. 

We  decided  thaf  the  simplest  thing  to  do,  from  our  stand¬ 
point  of  research  and  training,  would  be  to  choose  some 
reasonable  functions  with  the  correct  qualitative  behavior.  If 
the  price  was  increased,  sales  decreased  and  vice  versa.  But 
we  didn't  tell  the  players  what  these  formulas  were.  Again  our 
defense  was  that  in  any  realistic  situation  these  formulas  are 
not  known — and  may  not  even  exist.  Our  excuse  for  Ignorance  In 
all  these  cases  is  the  same:  "After  all,  this  is  the  way  things 
are  on  the  outside." 

There  still  remained  a  nxoxnber  of  other  problems.  We  wanted 
the  game  to  be  flexible,  which  is  to  say  we  wanted  definite 
reactions  to  changes  in  policy.  On  the  other  hand,  we  did  not 
vilsh  too  strong  a  reaction,  which  is  to  say,  we  wanted  stability. 

It  is  not  desirable  to  have  a  change  of  price  of  say  25^ 
on  a  $5.00  item  result  in  cornering  the  market  and  reducing 
the  other  players  to  bankruptcy. 
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In  addition,  there  was  a  quite  compelling  reason  for  making 
sure  that  no  crises  occurred.  The  American  Management  Association 
Is  using  this  business  game  as  part  of  an  Intensive  course  In 
decision— making .  Clearly,  If  the  players  are  charged  approxi¬ 
mately  one  thousand  dollars  for  a  tv/o  v;eeks  course.  It  Is  not 
desirable  to  have  anyone  go  bankrupt  In  two  days.  At  first,  we 
actually  thought  that  It  was  Impossible  for  this  to  happen  If 
any  reasonable  policy  was  pursued.  However,  we  made  the  mistake 
of  putting  two  comptrollers  together.  Now  without  any  personal 
prejudice  against  comptrollers,  apart  from  their  peculiar  fancy 
of  wanting  everything  in  triplicate,  I  think  that  It  Is  fair  to 
say  that  the  philosophy  of  these  gentlemen  may  be  expressed  as 
follows:  "Whenever  you  think  of  spending  a  dollar,  don't." 

The  result  Is  that  this  team  resolutely  refused  to  spend 
any  money  on  advertising,  any  money  on  research  and  development, 
any  money  on  anything  at  all.  The  result  was  that  after  two  or 
three  rounds,  they  went  bankrupt.  Since  this  was  a  demonstration 
game,  with  the  machine  programmed  for  a  full  five  teams,  we  had 
to  slip  them  money  surreptitiously  to  keep  them  In  the  game. 

Forewarned  by  this,  we  put  in  some  further  magic  formulas 
which  absolutely  prevent  bankruptcy.  A  team  pursuing  a  foolish 
policy  will  not  do  well,  but  It  will  exist. 

As  I  pointed  out  above,  we  wanted  a  flexible  game,  which  Is 
to  say  we  wished  to  observe  an  appreciable  change  when  there  was 
a  change  In  policy.  Yet  we  did  not  want  It  to  be  too  flexible, 
to  have  any  violent  ups  and  downs.  Consequently,  we  were  faced 
with  a  very  delicate  problem  of  balancing  the  Interactions.  In 
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order  to  do  this,  we  Indulged  In  a  considerable  amount  of 
experimentation,  playing  various  stages  of  the  game  ourselves. 

Members  of  the  group  were  appointed  devil's  advocates. 

One  would  be  chosen  to  follow  a  high  price,  no  advertising 
policy,  another  a  low  price,  extensive  advertising  policy,  and 
so  on.  Occasionally,  the  person  nominated  would  protest 
bitterly  that  his  assigned  policy  did  not  coincide  with  his  own 
Ideas.  No  matter,  It  was  necessary  to  try  all  extreme,  policies . 
As  a  matter  of  fact,  when  first  setting  up  the  game,  we  found 
that  quite  a  few  safeguards  had  been  omitted.  The  result  was 
occasionally  a  policy  of  raising  the  price  from  five  dollars  to 
ten  dollars  would  corner  all  the  money  In  the  game.  This  Is 
one  of  the  most  serious  problems  encountered  In  constructing 
mathematical  models.  In  any  realistic  situation,  there  are 
built— In  properties  which  automatically  eliminate  absurd 
policies.  Sometimes,  In  making  a  model  of  an  economic 
situation,  we  attempt  to  eliminate  what  appear  to  be  small 
effects,  and  find  that  precisely  these  small  effects  play  a 
determining  role  In  certain  processes. 

We  find  then  that  obviously  foolish  policies,  foolish  from 
the  standpoint  of  actual  practice,  do  very  well  In  artificial 
games.  We  call  these  policies  "gimmick  policies."  In  con¬ 
structing  a  simulation  process,  we  want  to  make  sure  that  no 
artificial  policies,  known  only  to  the  constructors  of  the  game, 
will  dominate  sensible  policies. 

There  are  a  number  of  games  around  the  country  In  which 
this  Is  true.  It  Is  hard  to  see  what  can  be  gained  from  the  play 
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of  such  games.  As  I  mentioned  above,  rather  ruefully,  in  our 
game,  this  is  certainly  not  the  case.  Even  a  complete  know¬ 
ledge  of  the  underlying  functions  does  not  appear  to  yield  any 
appreciable  advantage. 

This  is  where  luck  entered.  We  were  remarkably  fortunate 
in  the  relatively  short  time  that  we  devoted  to  the  construc¬ 
tion  of  the  game  to  come  up  with  choices  of  functions  and 
parameters  which  yielded  a  reasonably  sensitive  and  re^onably 
stable  game. 

Having  reached  this  stage,  we  decided  to  try  it  out  first 
on  vice— presidential  level  executives,  and  then,  in  May  of 
1957,  on  a  selected  group  of  presidents  of  large  companies. 

The  enthusiasm  generated  by  this  demonstration  was  so  great 
that  the  American  Management  Association  decided  to  Invest  a 
greal  deal  of  money  and  effort  upon  a  management  decision 
course  built  around  the  game.  This  was  started  at  the  end  of 
last  year,  amd  appears  to  have  met  with  success. 

I  would  like  to  discuss  briefly  in  conclusion  what  I  feel 
the  real  purpose  of  the  game  is,  and  hoW  it  can  be  used  most 
profitably.  At  the  present  time,  no  responsible  individual 
claims  that  games  of  this  type  can  be  used  to  resolve  actual 
industrial  problems.  We  constantly  warn  the  players  that  the 
situations  in  the  game  are  make-believe  situations,  and  thus 
not  to  be  taken  too  seriously.  If  research  and  development 
pays  off  well,  it  is  not  to  be  concluded  that  the  answer  to  any 
realistic  problem  is  more  research  and  development.  After  all, 
since  those  of  us  who  designed  the  game  were  partially  or  wholly 
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In  the  Operations  Research  racket,  it  is  clear  why  we  would 
want  to  emphasize  this  feature.  We  were  using  subliminal  per¬ 
ception  some  time  before,  without  the  aid  of  a  movie  screen. 

Amusingly  enough,  one  of  the  engineering  magazines  rather 
unethically  told  its  readers  how  to  beat  the  game.  Actually, 
the  policy  the  magazine  advocated  was  quite  wrong,  since  it  was 
based  upon  an  observation  of  only  about  one— fourth  of  the  whole 
process . 

V/e  make  no  pretense  that  this  simulation  process  is  an 
operational  tool  at  the  present  time.  Rather,  we  stress  that 
it  is  a  research  tool.  Research  was  for  a  while  quite  a  dirty 
word,  but  it  has  become  more  popular  in  recent  times  with  the 
aid  of  Sputnik.  One  can  now  assert  in  public  without  wincing 
or  apologizing  that  one  is  engaging  in  research. 

Apart  from  the  type  of  training  we  have  mentioned  above , 
how  cam  this  research  tool  be  used  in  a  most  profitable  way? 

In  the  first  place,  I  think  that  it  should  be  used  in  the 
universities  to  a  tremendous  extent.  One  of  the  aspects  of 
human  nature,  which  the  universities  have  refused  to  cater  to, 
is  the  gambling  instinct.  This  is  not  surprising,  considering 
that  what  used  to  be  called  progressive  education  refused  even 
to  admit  to  the  existence  of  the  competitive  instinct.  Yet, 
whether  we  like  it  or  not,  it  is  clear  from  a  study  of  all 
civilizations  on  the  surface  of  the  earth,  going  back  to  the 
ancient  Egyptian  and  Sumerian  tombs,  that  humans  love  to 
gamble.  In  these  tombs  of  five  and  six  thousand  years  ago,  one 
finds  dice  and  board  games  of  all  types, 
of  chess  and  checkers. 


ancient  predecessors 
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It  would  seem  to  me  that  games  of  this  type  introduced 
into  courses  in  business  administration,  mathematical  economics, 
operations  research,  and  many  other  subjects,  would  stimulate 
the  students  to  a  considerable  degree.  At  the  present  time,  a 
number  of  games  modeled  after  the  AMA  game  are  being  used  in 
various  universities  around  the  country. 

Secondly,  I  think  that  games  of  this  type  can  be  used  as 
super  intelligence  tests.  At  the  present  time,  intelligence 
tests,  although  given  widely,  are  not  taken  too  seriously.  One 
of  the  reasons  for  this,  it  is  generally  agreed,  is  that  what 
we  call  an  intelligence  test  is  actually  a  measure  of  only  a 
few  of  the  facets  of  human  Intelligence. 

One  of  the  basic  aspects  of  human  intelligence,  and  animal 
intelligence  as  well,  is  the  ability  to  adapt  to  environment, 
and  particularly  to  changing  environment.  In  other  words, 
intelligence  should  be  tested  in  terms  not  of  vihat  one  knows, 
bvit  of  what  one  can  learn. 

It  is  clear  that  no  static  test  can  measure  this  feature 
of  intelligence.  We  need  a  dynamic  process,  precisely  of  the 
general  nature  of  the  simulation  process  described  above. 
Although  there  is  little  doubt  that  processes  of  the  foregoing 
type  can  be  used  for  these  purposes,  much  remains  to  be  done 
before  they  can  be  used  for  quantitative  purposes.  It  is  not  as 
easy  as  one  might  think  to  detennlne  what  it  is  that  is  being 
measured  and  to  what  extent. 

I  do  believe  that  these  simulation  techniques  will  assvune  a 
greater  and  greater  role  in  the  future,  and  eventually  become 
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operational  tools.  The  appropriate  story  on  which  to  close  is 
the  following. 

A  stranger  who  loved  to  gamble  came  into  a  little  town  and 
inquired  about  the  possibility  of  some  action.  He  was  directed 
to  the  back  room  of  a  local  saloon  where  there  was  a  roulette 
wheel.  A  klndhearted  townsman  pointed  out,  however,  that  the 
wheel  was  crooked.  The  stranger  shrugged  his  shoulders  and 
said,  "I  know,  but  it’s  the  only  wheel  in  tovn^ . " 
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